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(57) ABSTRACT 

A deadlocked resource condition in a pool of shared 
.resources is detected by measuring a characteristic of 
resource utilization over a predefined time interval and 
comparing the measured characteristic in accordance with a 
predicted statistical relationship. If the measured resource 
utilization is inconsistent with the predicted statistical 
relationship, a deadlocked resource condition is determined 
to have occurred. 
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DETECTION OF A DEADLOCKED 
RESOURCE CONDITION IN A POOL OF 
SHARED RESOURCES 

BACKGROUND OF THE INVENTION 

1. Technical Field of the Invention 

The present invention relates in general to the field of 
network systems, and in particular, by way of example, and 
not limitation, to detection of a deadlocked resource condi- 10 
tion in a pool of shared resources. 

2. Description of Related Art 

In a typical network system, such as a telecommunication 
system or data network system, the network maintains 15 
centralized control over available resources, and allocates 
these resources to individual devices or processes in 
response to a resource request. This centralized control 
enables the network to share the available resources among 
a larger number of users, thereby allowing network opera- 20 
tors to offer a greater level of service at a lower cost. The 
sharing of resources among potentially competing devices or 
processes, however, causes network systems to be suscep- 
tible to resource conflict. This problem arises when two or 
more devices or processes attempt to access the same 2 5 
resource during the same time interval. These potentially 
conflicting uses of shared resources require the network 
system to maintain an established protocol that enables 
either the network or individual devices or processes to 
determine when access to a given resource is permissible. 30 

Resource locking is one technique commonly employed 
in network systems to avoid resource conflicts. This tech- 
nique utilizes a protocol in which the network signals the use 
of a resource by marking the resource as "used" or "busy." 
This notifies the network and/or competing processes that 35 
the resource cannot be accessed at that time. In operation, a 
process desiring access to a particular resource inspects the 
lock or flag associated with that particular resource before 
submitting a resource request. Alternatively, the network 
inspects the flag associated with the resource before alio- 40 
eating the resource to the particular process. If the flag 
indicates that the resource is currently "free" or "idle," the 
process is allocated the resource, uses the resource, and then 
releases the resource when the process is finished. On the 
other hand, if the flag indicates that the resource is "used" or 45 
"busy," the process and/or network waits for the resource to 
be released by the prior acquiring process before allowing 
access to the resource. 

If the network system configures the available resources 
into one or more pools of similar or identical resources, the 50 
resource locking technique may employ a "seizure" mecha- 
nism that attempts to seize a free (available) instance of a 
resource from the resource pool and allocate the seized 
resource to the requesting device or process. This seizure 
mechanism typically utilizes a search strategy or a linked list 55 
approach to identify free instances of the requested type of 
resource. If a search strategy is used, for example, the pool 
of the appropriate type of resource is examined in a specified 
order until a free resource is found and seized or the search 
is abandoned because it is determined that there are no free 60 
resources within the resource pool. If the linked- list 
approach is used, on the other hand, the first item of the 
linked-list (if there is an item in the linked-list) represents an 
available instance of the resource. This resource may then be 
seized by the seizure mechanism by changing the state of the 65 
found resource from idle to busy. Regardless of the type of 
seizure approach used, the end result will be either identi- 
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fication of an available resource within the resource pool or 
a report back to the device or process originally requesting 
the resource that "congestion" has occurred and, thus, no 
free resources of the type requested are currently available. 
If an instance of the resource is found and seized by the 
seizure mechanism, the seized resource is effectively locked 
or otherwise prevented from being seized again until the 
seized resource is freed by the reverse of the seizure mecha- 
nism. 

One undesirable situation that can arise in a resource 
locking scheme is a "deadlocked resource condition." For 
the purposes of the present invention, a deadlocked resource 
condition occurs when a device or process that has been 
allocated a shared resource fails to release the resource for 
illegitimate reasons, such as an error in communications, an 
error in system or application software, or an undesired 
operational state. For example, an error in the system or 
application software may cause the process or network to 
fail to release the resource when the process is complete, or 
the signal releasing the shared resource may not be received 
due to an error in communications. Moreover, the process to 
which the resource is allocated may encounter an unex- 
pected error and self-terminate, or the process may be 
terminated ("killed") by the operating system or another 
process without releasing the resource. This situation is 
referred to as process death, and may cause the shared 
resource to remain locked by the dead process potentially 
forever. 

A deadlocked resource condition may also occur due to 
conventional deadlock between competing processes. This 
conventional deadlock situation arises when a first process 
attempts to acquire a resource that is already locked by a 
second process, and the second process likewise attempts to 
acquire a resource that is already locked by the first process. 
Since neither process is able to release the lock sought by the 
other, neither process cane proceed. Both resources will 
remain locked until one of the conventionally deadlocked 
processes is terminated to allow the other process to con- 
tinue. 

If a deadlocked resource condition is not detected and 
corrected, and if the process or processes continue to cause 
deadlocked resource conditions due to a reoccurring error or 
reoccurring operational state, all available resources will be 
gradually consumed. This situation leads to a gradual deg- 
radation in the quality of service offered by the network, 
until the network eventually ceases to function. Therefore, in 
a network system which employs a resource locking 
scheme, there must be a mechanism for detecting a dead- 
locked resource condition in time for network operators or 
system software to take corrective action, such as tempo- 
rarily assigning additional resources to allow the network 
some ability to function, restarting the network to clear 
deadlocked resource conditions, and actually fixing the 
problem causing the deadlocked resource condition. 

Existing approaches have attempted to alleviate the prob- 
lems described above by utilizing either a timer-based or 
logic-based solution or by monitoring traffic congestion. In 
a timer-based solution, a separate timer is initiated for each 
resource allocation If the resource remains locked after a 
predetermined amount of time has expired, the network 
assumes that a deadlocked resource condition has occurred, 
terminates the process, and releases the resource. Although 
a timer-based solution has the potential to correctly detect 
deadlocked resource conditions in situations involving a 
definite upper time limit of resource usage, this solution 
proves to be inadequate in situations where the upper time 
limit is relatively long or indefinite. For example, because 
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users will only (normally) tolerate a call setup that is distribution, the measured variance is compared to k times 

measured in seconds and is well under a minute in maximum the measured mean (where k may vary between zero and one 

duration, the timer-based solution may perform well in depending on the degree of closeness to a Poisson model) If 

situations where the resources are allocated for call setup the determined variance is less than k times the determined 

only and are not used once the call has been completely 5 mean, then a deadlocked resource condition is determined to 

established. The call itself, however, can last indefinitely, exist. Conversely, if the determined variance is greater than 

and multi-day long calls are not impossible. Thus, in order k times the determined mean, then a deadlocked resource 

to avoid disconnecting a valid, but relatively long, call, a condition is determined not to exist, 

deadlock detection timer must be configured with a time [ n a second embodiment of the present invention, samples 

interval that is so long as to be impractical for early detection 10 0 f resource utilization are periodically measured over a 

of deadlock resource conditions. If deadlocked resource predefined time interval. The measured samples are then 

conditions were to start occurring frequently, the whole pool compared to a threshold minimum which comprises, for 

of resources may be consumed before the first timer expires. example, a predetermined value, a fraction of the average of 

Furthermore, at least one timer must be separately main- the is measured samples, a fraction of the maximum of the 

tained for each seized resource, thus adding to the cost of is measured samples, or a fraction of the historical average 

implementation, maintenance, and the cost of processor time resource utilization. If no measured samples fall below the 

per call. threshold minimum during the predefined time interval, a 

A logic-based solution, on the other hand, detects con- deadlocked resource condition is determined to exist, 

ventional deadlock among competing processes by moni- A third embodiment of the present invention detects a 

toring resources allocated to and requested by each process. 20 deadlocked resource condition in a resource experiencing an 

Conventional deadlock is detected if a cyclical pattern exists increased traffic load by exploiting the fact that deadlocked 

among competing processes. For example, if process A is resource conditions do not contribute to the variance of the 

allocated a first resource and requests a second resource, and resource utilization. This third embodiment periodically 

process B is allocated the second resource and requests the measures resource utilization over a predefined time interval 

first resource, the solution will detect the occurrence of 25 and determines a trend line of the measured resource utili- 

conventional deadlock. This logic-based solution, however, zation. This trend line is determined, for example, by 

is not only complex and difficult to implement in practice, performing linear regression analysis or by maintaining a 

but also fails to detect other causes of a deadlocked resource running average over the predefined time interval. If the 

condition, such as errors in system or application software trend line is positively inclined (indicating an increased 

and errors in communication. 30 traffic load and/or increased deadlocked resource 

Finally, an approach that monitors traffic congestion ini- conditions) and there is no increase in the standard error of 
tiates an alarm signal when all available resources are the samples beyond a predetermined limit, then a dead- 
utilized. This approach not only fails to warn network locked resource condition is determined to exist, 
operators or system software of a deadlocked resource In a fourth embodiment of the present invention, resource 
condition in time to take corrective action, but also fails to 35 utilization for multiple pools of resources are periodically 
resolve the problems mentioned above due to the inability measured over a predefined time interval If traffic is increas- 
distinguish between a true deadlocked resource condition ing within the network, then there will tend to be a corre- 
and a temporarily high traffic load. sponding increase in utilization for a set of positively 
/t herefore, in light of the deficiencies of exist ing 4Q correlated resource pools. The patterns of correlation 
approaches, the re is a need tor a detection mecEanism that between resource pools can be determined by experience. If 
carl detect a deadlocked resource condition in a pooTpf a particular resource pool demonstrates an upward trend in 
shared resources and that can be easi ly lmplemeSteQ witEm resource utilization during the predefined time interval, the 
existing net work systems in a cost eff ecti ve manner. trend is compared with the set of resource pools against 

*" • 1 " " ' which the particular resource pool has historically been 

SUMMARY OF THE INVENTION 4S shown to be correlated. If the trend of the particular resource 

Hie deficiencies of the prior art are overcome by the P 00 } * f eate [ ^ ^average trend ° f the se * of resou ; ce 

method and system of the present invention. For example, as P ook > men a deadlocked resource «> ndltlon » determined to 

heretofore unrecognized, it would be beneficial to exploit exist. 

known or predictable statistical properties of traffic-based 50 ^ technical advantages of the present invention include, 

resource utilization to detect a deadlocked resource condi- but arc not limited to, the following exemplary technical 

tion in a pool of shared resources by utilizing known or advantages. It should be understood that particular embodi- 

predictable statistical relationship(s). In fact, it would be ments ma y 001 involve any, much less all, of the following 

beneficial to periodically measure resource utilization over a exemplary technical advantages. 

predefined time interval and compare the measured resource 55 An important technical advantage of the present invention 

utilization to a predicted resource utilization. A deadlocked is that it enables network operators or system application 

resource condition is then determined to have occurred if the software to detect deadlocked resource conditions and 

measured resource utilization is inconsistent with the pre- thereby take corrective action. 

dieted resource utilization at a predefined confidence level. Another important technical advantage of the present 

In a first embodiment of the present invention, samples of 60 invention is the ability to exploit known or predictable 

resource utilization are periodically measured over a pre- statistical properties of traffic-based resource utilization to 

defined time interval to determine a mean resource utiliza- advantageously detect deadlocked resource conditions in a 

tion and a variance of the resource utilization. The deter- pool of shared resources. 

mined mean and the determined variance are then compared Yet another important technical advantage of the present 

in accordance with a known or predictable statistical rela- 65 invention is that it is both logically simpler and more 

tionship. For example, assuming resource utilization (e.g. generally applicable to a wide variety of network systems 

offer traffic) of the network approximates a Poisson and network applications than existing approaches. 
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Yet still another important technical advantage of the example, software, hardware, firmware, etc.), techniques, 

present invention is that it can be easily implemented within etc. in order to provide a thorough understanding of the 

existing network systems in a cost effective manner. invention. However, it will be apparent to one of ordinary 

The above-described and other features of the present sk ? U in th u e that P^ent invention may be practiced in 
invention are explained in detail hereinafter with reference . 5 ° £er embodiments that depart from these specific details. In 

. .,, . 4 . , t . .« _ . other instances, detailed descriptions of well-known 

to the illustrative examples shown m the accompanying . , . , . , , r /t _ - 

, . i j • -i . -ii ■ * *. ; iL methods, devices, logical code (hardware, software, 

drawings. Those skilled m the art will appreciate that the c * \ * j • 

j & , « j« . .j j c cu firmware, etc.), etc. are omitted so as not to obscure the 

described embodiments are provided tor purposes of lllus- j • c A. ^t. j , 

. .. « j*u* • i . description of the present mvention with unnecessary detail, 

tration and understanding and that numerous equivalent _ , . r , , . , , , , , , 

embodiments are contemplated herein. M . Furthermore, it should be emphasized that although the 

followmg description describes certain aspects of the present 

BRIEF DESCRIPTION OF THE DRAWINGS invention in the context of memory leak within a wireless 

communication system, the practice of the present invention 

Amore complete understanding of the method and system is not limited to such applications or systems. Rather, it will 

of the present invention may be had by reference to the 15 be apparent to one of ordinary skill in the art that the 

following detailed description when taken in conjunction teachings of the present invention are equally applicable to 

with the accompanying drawings wherein: detection of a deadlocked resource condition in network 

FIG. 1 illustrates a portion of an exemplary wireless systems in general. For example, the principles of the 

system with which the present invention may be advanta- present invention may be advantageously practiced in net- 

geously practiced; 20 work communication systems and data network systems, as 

FIG. 2 A illustrates an exemplary graph of memory utili- wel | as to other computer systems or individual computing 

zation over a time interval in which memory leak is deter- devices in which shared resources, such as memory, 

mined not to exist in accordance with a first embodiment of databases, printers, communication links, buses, internal or 

the present invention; external hardware devices, software applications and the 

id „„ i , . 25 like, are susceptible to a deadlocked resource condition. 

FIG. 2B lUustr ales an exemplary graph oi memory utili- ^ _ ' . r , . . . , 

zation over a time interval in which memory leak is deter- T he *f 0, ?\. thc W,releSS "™"»tara system embodiment 

mined to exist in accordance with the first embodiment of des J cr,b , e f. herem 15 P r0Vlded for At P ur P ose of «Pl™«°n, 

iU . . 4 . and not limitation, 
the present mvention; 

tti^ a «|» . , . - .... A preferred embodiment of the present invention and its 

FIG. 3A illustrates an exemplary graph of memory mm- adva ^ are Ust understood by refetring to mGS _ U6 of 

zation over a time interval in which memory leak is deter- tt _ , . , , . , c , 

, . . . 4 . , ... . i_ j * . the drawings, like numerals being used for like and corre- 

mined not to exist in accordance with a second embodiment r , u , . n c ~ Tr , 

c 4 , , . 4 . sponding parts of the vanous drawings. Referring to FIG. 1, 

of the present invention: c , . , , . ' . 

r a portion or an exemplary wireless system with which the 

FIG. 3B illustrates an exemplary graph of memory utili- prcscnt i nvcntion may b e advantageously practiced is 

zation over a time interval in which memory leak is deter- 35 depicted generally at 1. In this exemplary wireless system, 

mined to exist in accordance with the second embodiment of a mo bile station 10 communicates with a base station 40 

the present invention; ovcr ^ ^ interface 30. A data terminal 20, such as a 

FIG. 4A illustrates an exemplary graph of memory utili- portable computer, may also communicate with the base 

zation over a time interval in which memory leak is deter- station 40 over the same air interface 30 via for example, a 

mined not to exist in accordance with a third embodiment of 40 cellular modem. A mobile switching center 70 is connected 

the present invention; to the base station 40 and enables the mobile station 10 and 

FIG. 4B illustrates an exemplary graph of memory utili- the data terminal 20 to communicate with wireless devices 

zation over a time interval in which memory leak is deter- within the cellular network 105 and with wireline devices 

mined to exist in accordance with the third embodiment of connected to the Public Switched Telephone Network 

the present mvention; 45 (PSTN) 100. The mobile switching center 70, the base 

FIG. 5A illustrates an exemplary graph of average station 40 and other devices within the cellular network 105 

memory utilization for a set of positively correlated shared and PSTN each include one or more Pressors and program 

memory units; * memory units that control the functionalities of the associ- 

ery . , c 4M . ated device and that may be configured to operate in 

mu. m wustrates an exemplary ; grapn 01 memory uuu- accordance with the present invention as described herein- 

zation for a first shared memory unit of the set of positively below 

correlated shared memory units in which memory leak is _ ' . . , . . ,™„ , 

determined not to exist in accordance with a fourth embodi- , ™ e e ? ™P la ? W1 5 eless commumcation system of FIG 1 

ment of the present invention; ^ lncl " des . memor ? 5 «> 80 > ™ 6 ™ d } 10 

.,, , , .,. associated with the base stanon 40, the mobile switching 

FIG. 5C illustrates an exemplary graph of memory utili- 55 centef 70> , he netWQlk 105 ^ ^ WQ 

zation for a second shared memory unit of the set of respective iy. Each of ue shared memory units 50, 80, 106 

positively correlated shared memory units in which memory Md n0 ^ mt£) , number of ^ QI 

leak is determined to exist in accordance with the fourth Wocks of mem thereb providi a j of shaied 

embodiment of the present mvention; and memory resources mat may be allocated to requesting 

FIG. 6 illustrates a portion of an exemplary network 60 devices or processes. Alternatively, one or more of the 

system with which the principles of the present invention shared memory units may be divided into a number of 

may be advantageously practiced. resource pools that are further divided into discrete units or 

DETAILED DESCRIPTION OFTHE DRAWINGS " 0cks °\ mt T^ ^ 0r e . xamp,e ' ^ ^-T^^Tl 

70 may divide its shared memory unit 80 into five hundred 

In the following description, for purposes of explanation 65 or more resource pools 80, 82 and 86, where each resource 

and not limitation, specific details are set forth, such as pool represents the memory, files, records, etc. that may be 

particular circuits, logic modules (implemented in, for allocated by a corresponding program module or function - 
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ality of the mobile switching center 70. It should be under- In a first embodiment of the present invention, memory 
stood that although the following discussion describes cer- utilization is periodically measured over a predefined time 
tain aspects of the present invention with reference to shared interval. It should be noted that the sampling period used to 
memory units 50, 80, 106 and 110 and corresponding mea sure the memory utilization should be sufficiently large 
number in use (NIU) counters 60, 90, 107 and 120 the 5 SQ ^ ^ mea&ured ks m rekdvel Mependem . 
principles or the present invention are equally applicable to n r • . . , \ 
Resource pools 82, 84 and 86 and conespondiig resource P^ferab y, the sampling period k chosen to be greater Oian 
pool NIU counters 92, 94 and 96. ~ mean hold *g time > e -g-> grater than the average length of 
Referring again to FIG. 1, as a call is processed from an a caU - Alternatively, the sampling period is chosen to be a 
originating party to a terminating party, memory within the 1Q predetermined length, such as one hour. The mean utiliza- 
shared memory units 50, 80, 106 and 110 are allocated to tion. and the variance of the utilization over the predefined 
devices or processes associated with the particular call. For time interval are then determined from the measured 
example, if the mobile station 10 initiates a call to a wireline samples. The determined mean and determined variance are 
telephone 130, the communicating base station 40 allocates then compared in accordance with a known or predictable 
to the mobile station 10 memory from its associated shared relationship. A deadlocked resource condition is determined 
memory unit 50. The base station 40 then forwards the call 15 to exist if the determined mean and the determined variance 
to the mobile switching center 70, which performs further are inconsistent with the predicted relationship at a pre- 
processing and allocates to the particular call memory from defined confidence level, 
its associated shared memory unit 80. Other devices along 

the transmission path from the mobile station 10 to the This aspect of the first embodiment exploits the fact that 

wireline telephone 130 similarly allocate shared memory to 20 memory utilization typically follows a predictable pattern or 

the particular call until the call is ultimately terminated at the distribution. For example, in traffic-based systems, memory 

wireline telephone 130. The allocated memory along the utilization will typically follow either a Poisson distribution 

transmission path is typically marked or flagged by the or a Binomial distribution. As will be discussed in further 

associated devices as "used" or "busy" to indicate that the detail below, these distributions have predictable 

allocated memory cannot be accessed by other devices or 25 relationship(s) between the mean and variance. Accordingly, 

processes. if memory leak has occurred at a shared memory unit, the 

When one of the parties hangs up, the memory allocated mean utilization and the variance of the utilization will be 

at each of the respective shared memory units 50, 80 and 110 inconsistent with these predicted relationship(s). This incon- 

along the transmission path is released by a call tear-down sistency is caused by the fact that memory leak contributes 

procedure. Once the memory is released, the memory is 30 to the mean utihzation, but not the variance of the utilization, 
marked as "free" or "idle" to indicate that the memory may 

be reallocated to other devices or processes. A problem Assuming memory utilization within the system approxi- 

arises, however, when the allocated memory is not released mates a Poisson distribution, the mean utilization approxi- 

after the call is ended. This problem may be caused, for mates the variance of the utilization. Accordingly, memory 

example, by an error in communications, an error in system leak is detected by comparing the determined variance of the 

or application software, an abnormal termination of the call, utilization to k times the determined mean utilization, where 

or an uodesired operational state. Because the memory the value of k is between zero and one depending on the 

previously allocated to the call is still marked as used, this degree of closeness to a Poisson model. Optionally, the value 

memory cannot be reallocated and remains "locked", poten- of k is varied or ad j usted to i ncre ase or decrease the 

tially forever. This problem is further compounded by the sensitivity of memory leak detection. If the determined 

fact that an error at one point along the transmission path 40 . § ^ ^ fc ^ ^ determined ^ 

may cause the error to be propagated to addiUonal points mc ^ ^ determined to cxist 0^^, if the 

along the transmission path, resulting in locked memory at , , r . . . , r ' . , 

rr 1 1. j tc .u 1 1 j 4 determined variance is greater than k times the determined 

multiple shared memory units. If the locked memory is not .i_ 1 . « j . - j 

A*t*„t*A n „A if *u~ t v. ,„ M , 0 j ' mean utilization, then memory leak is determined not to 

detected, and 11 the error causing the locked memory con- . ' J 

tinues to occur, the available memory at one or more of the 45 CX1S ' 

shared memory units 50, 80, 106 and 110 will be gradually Referring to FIG. 2A, an exemplary graph of memory 

consumed. This is referred to as "memory leak", and, for the utilization over a time interval in which memory leak is 

purposes of the present invention, represents one case of a determined not to exist in accordance with the first embodi- 

deadlocked resource condition. ment of the present invention is illustrated. In this example, 

One aspect of the present invention detects the presence so memory utilization is periodically measured over a specified 

of memory leak by periodically measuring memory utiliza- time interval. Again, the sampling period should be suffi- 

tion at one or more of the shared memory units 50, 80, 106 ciently large so that the samples are relatively independent, 

and 110. This periodic measurement may be accomplished, Furthermore, it should be understood that the number of 

for example, by periodically polling a number in use (NIU) samples taken in this example is for explanatory purposes, 

counter 60, 90, 107, 120 associated with each shared 55 and may be greater or fewer than fifteen. Preferably, there 

memory unit 50, 80, 106, 110, respectively. The respective should be a sufficient number of samples to provide an 

NIU counters keep track of the number of records within the approximate distribution or minimize the effects of unusual 

associated shared memory unit that are currently being used occurrences. However, the number of samples does not need 

by devices or processes. Alternatively, memory utilization to be so large that it satisfies the central limit theorem. Based 

may be measured by periodically measuring the amount of 60 on the measured utilization in this example, the mean 

used memory or the percentage of the concerned memory or utilization (/i) is determined to be 14.53, and the variance of 

device pool that is currently allocated. The measured the utilization (o 2 ) is determined to be 12.91. Assuming that 

memory utilization is then compared to a predicted memory memory utilization follows a Poisson distribution and that k 

utilization, and memory leak is determined to have occurred is be equal to 0.8 based, for example, on experience or an 

if the measured memory utilization is inconsistent with the 65 estimate from historical memory utilization patterns, the 

predicted memory utilization at a predefined confidence relationship between the mean utilization and the variance of 

level. the utilization satisfy the following relationship: 
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Variance>Jt*mean 



12.91>0.8*14.53 



12,91>11.62 



Because the variance of the utilization is greater than k times 
the mean utilization, this relationship indicates that memory 
leak has not occurred. 
Referring to FIG. 2B, an exemplary graph of memory 



sampling period and the time interval should be sufficiently 
large to ensure the samples are relatively independent and 
provide a fair approximation of the actual memory utiliza- 
tion. The measured samples are then compared to a thresh- 
old minimum which comprises, for example, a predeter- 
mined value, a fraction of the average of the measured 
samples, or a fraction of the maximum of the measured 
samples. Alternatively, the threshold minimum comprises a 
fraction of the historical average memory utilization. If no 
measured samples fall below the threshold minimum during 



utilization over a time interval in which memory leak is 10 ^ deflned dme interval m leak is determine 3 

determined to exist in accordance with the first embodiment have occurred 

of the present invention is illustrated. Based on the memory FIG. 3A illustrates an exemplary graph of memory utili- 

utilization data in this example, the mean utilization (a) is zat i on ove r a time interval in which memory leak is deter- 

determined to be 24.53, and the variance of the utilization is mme d not t0 ex j st ^ accordance with the second embodi- 

determined to be 12.91. Again, assuming that the memory 15 men t of the present invention. The threshold minimum in 



utilization approximates a Poisson distribution and that k is 
equal to 0.8, the mean utilization and the variance of the 
utilization satisfy the following relationship: 

Variance <Jt*mean 
12.91<0.8*24.53 
12.91<19.62 



20 



25 



Because the variance of the utilization in this case is less 
than the mean utilization, this relationship indicates that 
memory leak has occurred. 

It should be emphasized that the practice of the first 
embodiment is not limited to memory utilization that 
approximates a Poisson distribution. Rather, the principles 30 
of the first embodiment are equally applicable to other types 
of distributions. For example, if the memory utilization 
approximates a Binomial distribution, the mean utilization is 
proportional to the variance of the utilization, and therefore, 



this case is selected to be 12 in accordance with the 
above -discussed principles. As the exemplary graph 
illustrates, samples 1, 8 and 14 fall below the threshold 
minimum during the predefined time interval. Consequently, 
this event indicates that memory leak has not occurred. In 
contrast, FIG. 3B illustrates an exemplary graph of memory 
utilization over a time interval in which memory leak is 
determined to exist in accordance with the second embodi- 
ment. In this case, no samples of the measured memory 
utilization fall below the threshold minimum during the time 
interval, and therefore, indicates that memory leak has 
occurred. 

A third embodiment of the present invention enables the 
detection of memory leak in a shared memory unit which is 
experiencing an increase in mean utilization. By exploiting 
the fact that memory leak does not contribute to the variance 
of the utilization, the third embodiment is able to distinguish 
between increases in mean utilization caused by an 
increased traffic load, and increases in mean utilization 
caused by memory leak. For example, in a Poisson distrib- 



the ratio of the mean and the variance approximates a 35 uted process, the mean utilization is equal to the variance of 

constant value. Specifically, the ratio of the mean and the the utilization. If an increase in the mean utilization is 

variance approximates 1/1 -p, where p is the probability that observed over a predefined time interval, the variance of the 

a particular file, record or memory cell of the shared memory utilization should also experience a corresponding increase, 

unit is in use. If the ratio of the mean and the variance fails If the variance of the utilization does not increase beyond a 

to fall below the predicted constant value for an extended 40 predetermined limit, then the increase in mean utilization is 



period of time (e.g. for the duration of the predefined time 
interval), then memory leak is determined to have occurred. 
The following table illustrates the relationship(s) between 
the mean and variance for some exemplary distributions. 



determined to be caused by memory leak, and not an 
increase in traffic load. 

Accordingly, the third embodiment periodically measures 
memory utilization over a predefined time interval and 
45 determines a trend line of the measured utilization. This 
trend line may be determined, for example, by performing 
linear regression on the measured samples or by maintaining 
a running average of the measured samples over the pre- 
defined time interval. If the trend line is positively inclined 
and there is no increase in the standard error of the samples 
(e.g., the variance of the samples from the trend line) beyond 
a predetermined limit, then a deadlocked resource condition 
is determined to exist. 

FIG. 4A illustrates an exemplary graph of memory utili- 
zation over a time interval in which memory leak is deter- 
mined not to exist in accordance with the third embodiment. 
In this example, the trend line of the sampled utilization as 
determined by linear regression is positively inclined, indi- 
cating either an increased traffic load or increased memory 
60 leak. The standard error of the samples is calculated to be 
In a second embodiment of the present invention, samples 4.57. Assuming this calculated standard error demonstrates 
of memory utilization are periodically collected over a a sufficient increase, then memory leak is determined not to 
predefined time interval. Again, these samples are collected have occurred. In contrast, FIG. 4B illustrates an exemplary 
by, for example, periodically polling the NIU counter asso- graph of memory utilization over a time interval in which 
ciated with a particular shared memory unit, or by periodi- 65 memory leak is determined to exist in accordance with the 
cally measuring the amount of used memory or the percent- third embodiment. In this case, the trend fine is also deter- 
age of total memory that is currently in use. Furthermore, the mined using linear regression, and the standard error of the 
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measured samples is calculated to be 1.85. Assuming the 
calculated standard error does not demonstrate a sufficient 
increase, then memory leak is determined to have occurred. 

In a fourth embodiment of the present invention, memory 
utilization for multiple shared memory units are periodically 5 
measured over a predefined time interval. These multiple 
shared memory units include, for example, different shared 
memory units associated with a single device, shared 
memory units associated with different devices, or some 
combination of both. If memory utilization is increasing 10 
within the network, then there will tend to be a correspond- 
ing increase in memory utilization for a set of positively 
correlated shared memory units. These patterns of correla- 
tion between shared memory units can be determined by 
experience. If a particular shared memory unit demonstrates 15 
an upward trend in memory utilization during the predefined 
time interval (which may be determined, for example, by 
performing linear regression or by maintaining a running 
average), the trend is compared with the set of shared 
memory units against which the particular shared memory 20 
unit has historically been shown to be correlated. If the trend 
of the particular shared memory unit is greater than the 
average trend of the set of correlated shared memory units, 
then memory leak is determined to have occurred. 

FIG. 5A illustrates an exemplary graph of average 25 
resource utilization for a set of positively correlated shared 
memory units. The trend in this exemplary graph has a slope 
of 0.9, as determined by linear regression analysis. FIG. 5B 
illustrates an exemplary graph of resource utilization for a 
first shared memory unit of the set of positively correlated 30 
shared memory units in which memory leak is not deter- 
mined to exist in accordance with the fourth embodiment of 
the present invention. As illustrated in FIG. 5B, the trend of 
the measured samples has a slope of 0.86, as also determined 
by linear regression analysis. Because the trend of the first 35 
shared memory unit is less than the trend of the set of shared 
memory units against which the first shared memory unit has 
historically been shown to be correlated, memory leak is 
determined not to exist. In contrast, FIG. 5C illustrates an 
exemplary graph of memory utilization for a second shared 40 
memory unit of the set of positively correlated shared 
memory units in which memory leak is determined to exist 
in accordance with the fourth embodiment of the present 
invention. The slope of the trend in FIG. 5C is determined 
to be 1.40 using linear regression. Accordingly, because the 45 
trend of the second shared memory unit is greater than the 
trend of the set of shared memory units, against which the 
second shared memory unit has historically been shown to 
be correlated, memory leak is determined to have occurred. 

If any of the foregoing embodiments detect a deadlocked 50 
resource condition, the exemplary wireless system of FIG. 1 
may initiate an alarm signal or notification, thereby enabling 
the network operator to take appropriate action, such as 
temporarily assigning additional resources to allow the 
network some ability to function, restarting the network to 55 
clear deadlocked resource conditions, and actually fixing the 
problem causing the deadlocked resource condition. 
Alternatively, t he exemplary wirele ss system may auto mati- 
cally i nitiate system or application software that pejorms 
simUa r TuDcTions i n response to 'detection of a deadlocke d 60 
r esource' c ondition: F or example, the exemplary wireles s 
s ys\em may automatically initiate n etwork d iagnostic" or 
maintenan ce modules that identify r es ources e x periencing a 
d eadlocked resource condition an? t hat terminate thej^ sp- 
c iatepypfocess or processes To* free trie resources. The mod- 65 
ules may also identity the resource pools experiencing 
deadlocked resource conditions and at least temporarily 
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allocate additional resources to the resource pools to allow 
the exemplary wireless system some ability to process calls 
or other events. 

It should be emphasized that although the foregoing 
description described the present invention in the context of 
memory leak within a wireless communication system, the 
practice of the present invention is not limited to such 
applications or systems. Rather, it will be apparent to one of 
ordinary skill in the art that the teachings of the present 
invention are equally applicable to detection of a deadlocked 
resource condition in network systems in general. For 
example, referring to FIG. 6, a portion of an exemplary 
network system with which the principles of the present 
invention may be advantageously practiced is depicted gen- 
erally at 2. This exemplary network system includes source 
devices or processes, such as a node 200, a computer 210, 
or a system or application process 220 which request access 
to shared resources from a network 230. The network 230 is 
also connected to one or more shared resources, such as 
communication links 250, printers 260, databases 270, file 
servers 280, memory 290 and other similar resources 300. It 
should be noted that although these shared resources 250, 
260, 270, 280, 290, and 300 are illustrated as being single 
devices, these shared resources 250, 260, 270, 280, 290, and 
300 may comprise one or more such resources grouped 
together as a pool of resources. A resource manager 240 
within the network 230 allocates or allows access to one or 
more of these shared resources 250, 260, 270, 280, 290, and 
300 in response to resource requests from the source devices 
200, 210 and 220. Because these shared resources 250, 260. 
370- 280, 290. and 300 are susceptible toproblems sim ilar 
to those discussed abov e, nam ely deadlocked resou rce 
c onditions, the principles ot tne present invention may be 
advantageously utilized to detect a deadlocked resour ce 
condition in a pool of shared Resource, a n d^ thereby allo w 
network operators or system software to take correctiv e 
k'^ fton. ^ 

Although preferred embodiments) of the method and 
system of the present invention has been illustrated in the 
accompanying Drawings and described in the foregoing 
Detailed Description, it will be understood that the present 
invention is not limited to the embodiments) disclosed, but 
is capable of numerous rearrangements, modifications, and 
substitutions without departing from the spirit and scope of 
the present invention as set forth and defined by the follow- 
ing claims. 
What is claimed is: 

1. A method for detecting a deadlocked resource condition 
in a pool of shared resources, the method comprising the 
steps of: 

measuring at least one characteristic of resource utiliza- 
tion over a predefined time interval; 
comparing said at least one measured characteristic in 
accordance with a predicted statistical relationship; and 
determining whether said at least one measured charac- 
teristic is inconsistent with said predicted statistical 
relationship at a predefined confidence level, thereby 
indicating that said deadlocked resource condition 
exists. 

2. The method of claim 1, wherein said step of measuring 
comprises measuring a mean resource utilization and a 
variance of said resource utilization. 

3. Hie method of claim 2, wherein said step of comparing 
comprises comparing said mean resource utilization with 
said variance. 

4. The method of claim 2, wherein said step of comparing 
comprises comparing said variance to k times said mean 
resource utilization. 
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5. The method of claim 4, wherein said step of determin- 23. The method of claim 1, further comprising the step of 
ing comprises determining whether said variance is less than initiating a notification in response to a determination that 
k times the mean resource utilization. said deadlocked resource condition exists. 

6. The method of claim 5, further comprising the step of 24. The method of claim 1, further comprising the step of 
adjusting the value of k in accordance with a desired 5 automatically initiating a diagnostic module in response to a 
sensitivity for deadlocked resource condition detection. determination that said deadlocked resource condition 

7. The method of claim 1, wherein said step of measuring e3a f!?' , , r , , 

comprises periodically measuring a mean resource utiliza- A method for detecting a deadlocked resource 

tion and a variance of said resource utilization. condition, the method compnsmg the steps of: 

8. The method of claim 7, wherein said step of comparing 10 measuring a mean resource "HhzaUon and a resource 
comprisescomparingratiosofsaidmeanresourceutilization nutation variance over a predefined time interval; 
and said variance to a predetermined value. comparing said mean resource utihzaUon to said resource 

9. The method of claim 8, wherein said predetermined utilization variance in accordance with a predicted 
value is approximately one minus p, where p is the prob- J statistical relaUonsbip and 

ability that a particular resource in said pool of shared is determining whether said mean resource utilization and 

resources is in use said resource utilization variance are inconsistent with 

ia -m. .« «" ci' o i_ • j . c . d said predicted statistical relationship, thereby indicat- 

10. Tne method of claim 8, wherein said step of deter- m a deadlocked resource condition. 

mining comprises determining whether any of said raUos faU 26 ^ method of daim 25j wherein saM st of com . 

below said predetermined value during said predefined time paring comprises coding said resource utilization vari- 

interval, thereby indicating that said deadlocked resource 20 ^ to k said mean resource utilization, 

condition exists. 27. The method of claim 26, wherein said step of deter- 

U. The method of claim 1, wherein said step of measuring mining comprises determining whether said resource utili- 

comprises periodically sampling resource utilization over za tion variance is less than k times said mean resource 

said predefined time interval. utilization. 

12. The method of claim 11, wherein said step of com- 25 28. A method for detecting a deadlocked resource 
paring comprises comparing samples from said periodical condition, the method comprising the steps of: 
sampling of resource utilization to a threshold minimum. periodically sampling resource utilization over a pre- 

13. The method of claim 12, wherein said threshold defined ume interval, generating a plurahty of samples 

minimum is selected from the group consisting of a prede- therefrom- 

termined value, a fraction of a mean of said samples, a 30 J^u n fc,;^, m «wtn * 

. , 9 . _ . « , . r ' comparing each 01 said samples to a threshold minimum: 

fraction of a maximum of said samples, and a fraction of an and 

historical mean resource utilization. , • . . t _ . - , . , . 

+ A , r . . , . . - . , determimng whether none of said samples is less than said 

14. The method of claun 12, wherein said step of deter- , 7? • • *u t • j- *• j ji 1 j 

- f , , threshold minimum, thereby indicating a deadlocked 
mining comprises determining whether any of said samples 

r 11 li -j a. l u • • j ■ • j j *j j resource condition. 

fall below said threshold minimum during said predefined 35 ~ ft m, *u j * t ■ 10 ^ a ♦ * 

i .1 1 * j • j % 1 I 29. The method of claim 28, wherein said step of pen- 
time interval, thereby indicating a deadlocked resource „ . . „ „. r r , 
condition odically sampling comprises periodically polling a number- 

15. The method of claim 1, wherein said step of measur- m *^f e ^ Unter ', , c , . - Q . . , . . . , 

j , 30. The method of claun 28, wherem said predetermmed 

mg comprises measurmg a resource utihzaUon trend and a .. . . , . *u u w *■ c 

. * « cm * j • » time interval is greater than a mean holding tune of a 

standard error of said resource utilization trend over said 40 to * 

redefined time interval resource. 

1* tt. j c * 1 ■ I* l * ♦ j 31. The method of claim 28, wherem said threshold 

16. The method of claim 15, wherein said resource . A , r ' ... r , 
..... . « • , , - . .. minimum is selected from the group consisting of a prede- 

utilization trend is measured by performing linear regres- . , . - . c c • j 1 

' r & termmed value, a fraction of a mean of said samples, a 

lL j r 1 • 1e , • « . r _ fraction of a maximum of said samples, and a fraction of an 

17. The method of claim 15, wherem said step of com- 45 ... . »• 

. « j « . , historical mean resource utilization, 

paring comprises companng said standard error to a prede- ^ mM for detecti deadlocked resource 

termmed value. .... tl _ , ■ ■ * r 

18. The method of claim, 17, wherein said step of «■*»»•..«>» method compnsmg the steps of: 
determining comprises determining whether said standard measuring a standard error of resource unhzation over a 
error is less than the predetermined value, thereby indicating 50 P re e time interva ^ 

that said deadlocked resource condition exists. comparing said standard error to a predetermined mea- 

19. The method of claim 1, wherein said step of measur- surement limit; and 

ing comprises measuring a resource utilization trend over determining whether said standard error is less than said 

said predefined time interval. predetermined measurement limit, thereby indicating a 

20. The method of claim 19, further comprising measur- 55 deadlocked resource condition. 

ing an average resource utilization trend over said pre- 33. Th e method of claim 32, further comprising measur- 

defined rime interval for a plurality of resource pools against m g a resource utilization trend. 

which said pool of shared resources has shown a positive 34. The method of claim 33, wherein the method is 

correlation. initiated in response to said resource utilization trend being 

21. The method of claim 20, wherein said step of com- 60 positively inclined. 

paring comprises comparing said resource utilization trend 35. A method for detecting a deadlocked resource 

to said average resource utilization trend. condition, the method comprising: 

22. The method of claim 21, wherein said step of deter- measuring a resource utilization trend for a pool of shared 
mining comprises determining whether said resource utili- resources over a predefined time interval; 

zation trend is greater than said average resource utilization 65 measuring an average resource utilization trend for a 

trend, thereby indicating that said deadlocked resource con- plurality of resource pools against which said pool of 

dition exists. shared resources has shown a positive correlation; 
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comparing said resource utilization trend for said pool of 
shared resources with said average resource utilization 
trend for said plurality of resource pools; and 

determining whether said resource utilization trend for 
said pool of shared resources is greater than said 
average resource utilization trend for said plurality of 
resource pools, thereby indicating a deadlocked 
resource condition. 

36. A system for detecting a deadlocked resource 
condition, the system comprising: 

a processing device; 

a memory unit coupled to said processing device; and 
a plurality of instructions stored on said memory unit 
which when executed on said processing device cause 
said processing device to operate so as to: 
measure at least one characteristic of resource utiliza- 
tion over a predefined time interval, 
compare said at least one measured characteristic in 
accordance with a predicted statistical relationship, 
and 

determine whether said at least one measured charac- 
teristic is inconsistent with said predicted statistical 
relationship at a predefined confidence level, thereby 
indicating that said deadlocked resource condition 25 
exists. 

37. The system of claim 36, wherein said plurality of 
instructions include instructions which when executed on 
said processing device cause said processing device to 
operate so as to: 

measure a mean resource utilization and a variance of said 

resource utilization, 
compare said variance to k times said mean resource 

utilization, and 
determine whether said variance is less than k times said 

mean resource utilization, thereby indicating that said 

deadlocked resource condition exists. 

38. The system of claim 37, wherein said instructions 
further include instructions which when executed on said 
processing device cause said processing device to operate so 
as to: 

adjust the value of k in accordance with a desired sensi- 
tivity for deadlocked resource condition detection. 

39. The system of 36, wherein said plurality of instruc- 
tions include instructions which when executed on said 
processing device cause said processing device to operate so 
as to: 

periodically measure a mean resource utilization and a 
variance of said resource utilization, 

compare ratios of said mean resource utilization and said 
variance to a predetermined value, and 



determine whether any of said ratios fall below said 
predetermined value during said predefined time 
interval, thereby indicating that said deadlocked 
resource condition exists. 

40. The system of claim 36, wherein said plurality of 
instructions include instruction which when executed on 
said processing device cause said processing device to 
operate so as to: 

periodically sample resource utilization over said pre- 
defined time interval, generating a plurality of samples 
therefrom; 

compare each of said samples to a threshold minimum; 
and 

determine whether none of said samples is less than said 
threshold minimum, thereby indicating that said dead- 
locked resource condition exists. 

41. The system of claim 36, wherein said plurality of 
instructions include instruction which when executed on 
said processing device cause said processing device to 
operate so as to: 

measure a standard error of resource utilization over said 

predefined time interval; 
compare said standard error to a predetermined measure- 
ment limit; and 
determine whether said standard error is less than said 
predetermined measurement limit, thereby indicating 
that said deadlocked resource condition exists. 

42. The system of claim 36, wherein said plurality of 
30 instructions include instructions which when executed by 

said processing device causes said processing device to 
operate so as to: 

measure a resource utilization trend for a pool of shared 
resources over said predefined time interval; 

measure an average resource utilization trend for a plu- 
rality of resource pools against which said pool of 
shared resources has shown a positive correlation; 
compare said resource utilization trend for said pool of 
shared resources with said average resource utilization 
trend for said plurality of resource pools; and 
determine whether said resource utilization trend for said 
pool of shared resources is greater than said average 
resource utilization trend for said plurality of resource 
pools, thereby indicating that said deadlocked resource 
condition exists. 

43. The system of claim 36, wherein said processing 
device comprises a device selected from the group consist- 
ing of a mobile switching center, a base station and a 
resource manager. 
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